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Content servers 






2.01 


Central Processing Unit (CPU) 


2.03 


Addressable Memory 

software, e.g..: 

-operating system and other system programs 2.31 
-web browser and associated applications 2.32 
-web server applications 2.33 
-program modules, agents etc. 2.34 
-DBMS 2.35 

-Communications and network applications 2.36 


2.04 


Stored data: 
-files 

-multimedia data 
-etc. 
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Recognition 
20 



k Annotation 
V 30 



Linking/Retrieval 
40 [ 



k Presentation 
V 50 



20.02 

receives electronic 
document (e.g., web 
page) 



30.02 

Insert identifiers into 
electronic page to 
associate identifiers 
with corresponding 
Key Elements 



20.04 

parse document 
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20.06 

Parsed data compared 
to Key List for match 


1 


r 



40.02 

User selects an 
annotated key element 
on document 



30.04 

Annotated document 
may be presented to 
user 



50.02 

Delivery of information 
to computer system 
associated with user 



40.04 

sources of information 
associated with key 
element are called 



30.06 

Make Annotated Key 
Elements user 
perceivable 



40.06 

Applications 



40.08 

URLs 



50.04 

User may interact with 

information, e.g., 
purchase product via 
user interface coupled 

to delivered 

information 



40.10 

Data objects, e.g., 
files streaming 
media 



20.08 

For each match a key 
element identifier is 
determined 



20.10 

Output of recognizer 

module sent to 
Annotator module 
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Key Element Identifier List (Key List) 4,0 



Key Element I Identifier 

harry potter and the goblet of fire | 0 

101 vacations to change your life | 1 

harry potter & the doomspell tournament | 2 

harry potter & friends | 3 

harry potter & the chamber of secrets | 4 

the brethren | 5 

1999 zagat america's top restaurants | 6 
chicken soup for the mother's soul | 7 
tuesdays with morrie | 8 
easy prey | 9 

harry potter & the goblet of fire | 10 

oh, the places you'll go | 1 1 

harry potter & the prisoner of azkaban | 1 2 

harry potter & the sorcerer's stone | 1 3 

heartbreaker | 14 

who moved my cheese? | 1 5 

it's not about the bike | 16 

the house on hope street | 17 

peanuts | 1 8 

before i say good-bye | 1 9 
britney spears | 20 
body-for-life | 21 

dr. Shapiro's picture perfect weight loss | 22 

dust to dust | 23 

the bear & the dragon | 24 

the lion's game | 25 

sony playstation 2 | 26 

ten things i wish i'd known-before i went out into the real world | 27 
dragonball z | 28 

secret codes for sega dreamcast | 29 

purple cane road | 30 

titleist | 31 

titleist irons | 32 

titleist drivers | 33 

palm iii | 34 

palm v | 35 

palm vi | 36 

apple computer | 37 

harry henderson | 38 




4.2 
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&2 

Browser detects that the user has 
navigated to a new electronic page. 




r 


04 

Retrieve the collection of all frames 
in document. 




r 



06 

If frame contains multiple sections, 
retrieve predefined sections from 
the current frame. 



6.16 

Make the next frame the current 
frame. 



6J* 

Maintain a list of Key Elements and 
their positions in the current 
section. 



6.10 

Alter the current section by 
inserting annotations in the section 
so they are asociated with the Key 
Elements. 





6.14 

Make the current section the next 
section. 
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7.0 



L? 

User selects an annotated Key 
Element. 



X 



7.4 

The user's computer system sends a 
request to an application on the CCS, 
specifying the Key Element identifier 
for the annotated Key Element. 




7.14 

The identifier does not exist. Take 
prescribed course of action, e.g., 
inform the user that the annotated key 
element is no longer supported. 



Yes 

JL 



Identify the target page URL 
associated with the Key Element 
identifier. 



7.10 

Instruct browser to redirect itself to the 
target page URL. 



7.12 

User's computer receives data from 
target URL. 
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8.0 



CONTENT PROVIDER 
WEB SERVER 



Content 
document 




Tracker Module 



20 

Recognizer Module 



30 

Annotator Module 






1 





BROWSER 2.32 



8.2a 
Annotated 
document 




8.10 
User selects 
annotated 
Key Element 



8.12 

Target document 

returned to 
Client computer 



CLIENT 
(CONSUMER) 
COMPUTER 

SYSTEM 
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Key List 



8.8 




Network cloud 



FIG. 8 



9,2 

User starts browser, e.g., Internet Explorer. 



9A 

Internet Explorer loads the Key Element 
Browser Helper Object (BHO). 



9J5 

The BHO contacts the CCS server, asking 
what version of the Key List is available. 




Yes- 



9.10 

Load a new version of the Key List from the 
server. 



9.12 

Load the Key List from the user's computer 



9.14 

Generate a set of key element list maps in 
memory from the Key List. 



9.16 

Stay alive until Internet Explorer terminates. 
While the BHO is alive it includes a tracking 
for determining when the user goes to a new 
web page. When notified, the BHO annotates 
the new web page. 



9.18 

Browser closed. The BHO releases all 
resources and terminates. 



FIG. 9 



11.2 \ 
PRODUCT SEARCH 
MODULE J 



11.0 



11.4 

QUERY BASED ON 
ANNOTATED KEY 
ELEMENT SELECTED 
BY USER 



- optional - 



11.8 

DOES USER HAVE PROFILE 
STORED ON ASSOCIATED 
^COMPUTER SYSTEM?^ 



-yes> 



11.10 
MODIFY QUERY 
ACCORDING TO 
USER PROFILE 



11.6 

INPUT QUERY INTO 
SEARCH ENGINE 



-no- 



L optional 



11.12 11.14 
RUN QUERY IN RUN QUERY ON 

PRODUCTS NETWORK, e.g. WORLD 
DATABASE WIDE WEB 



11.18 

RETURN OUTPUT OF 
SEARCH ENGINE TO 
USER 



target page may include user 
interfaces allowing User to 
electronically undertake 
transactions such as select and 
pay for presented products 
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Monthly Review of Tech Gadgets 



The Palm V ™ 

A perfect mobile device featuring... A 2.2 

Hot Laptops / 

The Sony Vaio ™ leads the pack not only for extra options 

but has the whole multimedia nine yards thrown in... 
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YOUR ACCOUNT | HELP | WHAT DO YOU THINK OF OUR SITE? 




BizRate.com' 

13.3 



home > search results 
Search Marketplace? 



May 4.2001 



"nine yards" 




Entire Marketplace g|J 



Search No w 



Browse 

All Departments 
Departments 
Apparel 

Book s & Magaz ines 
^PHLP uter H ardw are 
Comp uter Software 
DVDs & Videos 
Electronics 
Food & Drink 
Gifts & Rowers 
Health & Beauty 
Home & Garden 
Music 

Offic e Supplies 
Pets & Hobbies 
Sports & Out doors 
Toys & Video Games 
Services 
Auctions 
Automotive 
Personal Finance 
Travel & Leisure 



There are 6 matches for "nine yards" 

Top 2 Popular Product Matches 

The Whole Nine Ya rds ( dvd | vhs) , 2000 

The Whole Nine Y ards by Original Soundtrack, (eg) , 02/29/2000 

More Product Matches 

DVD & Videos 

Top Matches 

The Whole Nine Yards ( dvd | vhs) , 2000 



Music 

Top Matches 

The Whole Nine Yards by Original Soundtrack, ( cp) , 02/29/2000 
The Nine Yards [Edited] by Paperboy, ( CD i cass) , 12/16/1993 
Th e Nine Yards [PA ] by Paperboy, ( CD | cass) , 12/16/1993 



W Pets & Hobbies 

-™ Top Matches 
Collectibles 



Toys & Video Games 

Top Matches 

Outdoor Games & Fun > Other 



Home I About B izRate.com | Mercha nt Se rvices 
BizRate® and BizRate.corn® are registered servicemarks. Copyright 1996-2001 All rights reserved. 
See term s of use . See Our Privacy Policy. 
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